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Abstract 



Traditionally, confirmatory factor analytic models are 
tested against a null model of total independence. Usinq 
randomly generated factors in a matrix of 46 aptitude tests, 
this approach is shown to be unlikely to reject even random 
factors. An alternative null model, based on a single 
general factor, is suggested. In addition, an index of model 
efficiency is introduced as a useful adjunct to contemporary 
indices of overall fit. The usefulness of these procedures 
are demonstrated in a confirmatory factor analysis based on 
Guilford's Structure of the Intellect model. 
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Confirmatory factor analysis (Joreskog, 1969; Joreskoq 

& Sorbom, 1979) is designed to test the fit of a particular 

model to an observed covariance or correlation matrix. 

2 

Oriqinally, Joreskoq (1969) proposed a X qoodness-of -f it 
test designed to determine whether a model can account for 
observed correlations between measured variables. Several 
authors (e.g., Bentler, 1980; Joreskog, 1969, 1979) have 
pointed out that this test is overly dependent on sample 
size in that the probability of rejecting a model increases 
as the sample size increases. In other words, support for 
a given model would be more likely in a small sample, while 
in a large sample, a plausible model would be rejected due 
to minute difference between the observed and predicted 
intercorrelations . 

Because of the sample size problem, several authors 
(McGaw & Joreskog, 1971; Tucker & Lewi.-, 1973) have urged 
the use of a null model in the testing of exploratory factor 
analytic hypotheses. More recently, Bentler (1980) has ex- 
tended this idea to confirmatory factor analysis and other 
multivariate techniques based on maximum likelihood estima- 
tion. Typically, the null model is the case where no common 
*" factors are assumed. Because the null model is a nested 
case of a more substantive proposed model, it can be statis- 
tically compared with the model of interest. 

The purpose of the present study is to demonstrate a 
potential problem with this procedure and to offer several 
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suqqestions for dealing with this problem. The problem 

associated with the use of a null model is that 

human abilities are positively correlated (see Brody & 

Brody, 1978, for review), and one would not expect to 

find support for such a model regardless of the alternative 

model that is hypothesized. 

To -demonstrate this supposition, data from Guilford's 
Aptitude Research Project were reanalyzed. In this study 
(Guilford, 1968), 46 tests were given to 197 high school 
students. Initially, a factor structure based on a random 
pattern was proposed. Specifically, odd numbered tests 
were designated as factor 1, and even numbered tests were 
designated as factor 2. When random factor l.(Rl) was con- 
trasted with the null model of total independence it was 
highly significant (X 2 difference (23) = 714.54 p < .001). 
Similar results were obtained for random factor 2 (R2) , 
X 2 difference (23) = 487.5* , P < • 001. ...... These, two models * 

were then combined into an <6bl.i>ue two-factor model 
which was significantly better than either of the one-factor 
models, X 2 difference (24) > 662.54 , P < -001. ^he *inal 
factor loadings for the random two-facto/ model were inspected, 
and it is noteworthy that all factor loadings were significant. 
At this point conventional procedures have provided no basis 
for rejecting the"' random models. Indeed, their tenability 
has been repeatedly verified. 

The analysis above clearly indicates a problem with the 
uncritical use of confirmatory factor analysis. First, the 



commonality among correlated tests of mental ability can 
be subdivided into two or more random factors, and second, 
traditional ways of evaluating confirmatory models do not 
provide rigorous tests of the appropriateness of a given 
model. 

A possible solution to this problem lies in a redefini- 
tion of the null model. Rather than test theoretical models 
against the untenable null hypothesis of total independence, 
models can be tested against the more likely hypothesis 
that a single common factor accounts for the interrelations 
between measured variables. Thus, in the above example, one 
might propose that the two-factor random model be compared 
to a one factor general model. 

in the 

present example, the X 2 /df ratios are almost identical 
(2.348 vs 2.351) .suggesting that the more complex two- 

factor model is no better than the simple one factor model. 
By the law of parsimony, the one factor model should be. the 

accepted model. 

An alternative to a significance testing is to compare 
the fit of a single factor model to a more complex multi- 
factorial model. Bentler (1980) has proposed a fit index for 
.univariate models (coefficient delta) which is a slight 
.edification of the more familiar Tucker-Lewis ,1973, index 

for evaluating exploratory models. The index is given by 

the following formula: 
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A » (F k - L^lo 

where F and F correspond to minimum function values for 
k 1 

two hierarchical (i.e., nested) models. As shown by Bentler 
(1980), coefficient delta ranges between zero and one, and 
consequently, provides a normed fit index for competing 
models. Unfortunately, delta will increase as model complexitv 
increases, or stated another way, delta will increase as more 
parameters are free to vary. 

A slightly modified special instance of Bentler 's (1980) 
coefficient delta avoids the problem of the influence of 
degrees of freedom on delta. This efficiency index, hereafter 
called epsilon is given by: 

e = 100 (F k - ^/((F^) * (S k - ) 
where F. is the minimum fit function evaluated for the model 



of interest, F^ is the minimum fit function for the null 
model of complete independence, S_ k is the total number of 
independent parameters in F_ k , and is the total number of 
independent parameters for F^. The epsilon index adiusts for 
the number of free parameters, and conseauently models which 
differ in degrees of freedom are more directly comparable. 
The index may be thouqht of as the per parameter averaqe 
increase in fit. Thus, the index is referred to as a measure 
of model efficiency. 

The use of Bentler' s delta and the proposed epsilon are 
shown in the following extension of the previous example. 
According to Guilford's Structure of Intellect model, one-half 
of the tests in the present battery are tests which are com- 
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nrised of semantic content. Thus, two underlying factors, 
symbolic and semantic content can be hypothesized. Usinq 
this conceptualization, a number of alternative models, as 
well as the two-factor random model discussed earlier, are 
aiven in Table 1. As shown in "'able 1, when cnef f ic ien* rielta 
is used, models with a larqer number of free parameters 
generally have a better fit than models with fewer free 
parameters. To illustrate the two-factor random model 
f-Rl + R2) is better than the theoretically based semantic or 
symbolic models (.389 > .184 and .38<> > .236). Similarly, 
a randomly generated three factor model (G + Rl + R2) is 
better than and theoretically based two-factor model 
(SEM + SYM) using coefficient delta as the bases for compari- 
son (.537 >' .437). The epsilon coefficients provide a dif- 
ferent picture. In two cases, the theoretically based models 
(i.e., SYM, SFM + SYM) have larqer efficiency indices 

than the random models (i.e., Rl + R2 and G + Rl + R2) . 
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Table 1 

Delta and Fpsilon Coefficients 



delta epsilon 

1. Semantic only (SEM) .184 .802 

2. Symbolic only (SYM) .236 1.026 

3. Rl + R2 .^9 -827 

4. SEM + SYM .437 .929 

5. General (G) .388 .842 

6. G + Rl + R2 .537 -577 
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